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ABSTRACT 



A vehicle driver or machine operator sleepiness monitor, 
configured as a self-contained module, for steering wheel or 
dashboard mounting, provides for individual driver/operator 
interrogation and response, combined with various objective 
sensory inputs on vehicle condition and driver control 
action, and translates these inputs into weighing factors to 
adjust a biological activity circadian rhythm reference 
model, in turn to provide an audio- visual sleepiness warning 
indication. 

9 Claims, 18 Drawing Sheets 
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SLEEPINESS DETECTION FOR VEHICLE 
DRIVER OR MACHINE OPERATOR 

BACKGROUND OF THE INVENTION 

This invention relates to human sleepiness, drowsiness or 
(lack of) alertness detection and monitoring, to provide a 
v^^aming indication in relation to the capacity or fitness to 
drive or operate (moving) machinery. 

Although its rationale is not fully understood, it is gen- 
erally agreed that sleep is a powerful and vital, biological 
need, which — if ignored — can be more incapacitating than 
realised, either by a sleepy individual subject, or by those 
tasking the subject. 

As such, the invention is particularly, but not exclusively, 
concerned with the (automated) recognition of sleepiness 
and performance-impaired fatigue in drivers of motor 
vehicles upon the public highway. 

Professional drivers of, say, long-haul freight lorries or 
public transport coaches are especially vulnerable to fatigue, 
loss of attention and driving impairment. 

With this in mind, their working and active driving hours 
are already carefully monitored to ensure they are within 
prescribed limits. 

Road accidents, some with no apparent external cause, 
have been attributed to driver fatigue. 

Studies, including those by the Applicants themselves, 
(see the list of references at the end of this disclosure), into 
sleep-related vehicle accidents have concluded that such 
accidents are largely dependent on the time of day. 

Age may also be a factor — with young adults more likely 
to have accidents in the early morning, whereas older adults 
may be more vulnerable in the early afternoon. 

Drivers may not recollect having fallen asleep, but may be 
aware of a precursory sleepy state, as normal sleep does not 
occur spontaneously without warning. 

The present invention addresses sleepiness monitoring, to 
engender awareness of a state of sleepiness, in turn to 
prompt safe countermeasures, such as stopping driving and 
having a nap. 

Accidents have also been found to be most frequent on 
monotonous roads, such as motorways and other main roads. 

Indeed, as many as 20-25% of motorway accidents seem 
to be as a result of drivers falling asleep at the wheel. 

Although certain studies concluded that it is almost 
impossible to fall asleep while driving without any warning 
whatsoever, drivers frequently persevere with their driving 
when they are sleepy and should stop. 

Various driver monitoring devices, such as eyelid move- 
ment detectors, have been proposed to assess fatigue, but the 
underlying principles are not well-founded or properly 
understood. 

Sleepiness in the context of driving is problematic, 
because the behavioural and psychological processes which 
accompany falhng asleep at the wheel may not typify the 
characteristics of sleep onset commonly reported under test 
conditions and simulations by sleep laboratories. 

Driving will tend to make a driver put considerable effort 
into remaining awake, and in doing so, the driver will exhibit 
different durations and sequences of psychological and 
behavioural events that precede sleep onset. 

As underlying sleepiness may be masked by this prefac- 
ing compensatory effort, the criteria for determining whether 
a subject is falling asleep may be unclear. 

Indeed, the Applicants have determined by practical 
investigation that parameters usually accepted to indicate 
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falling asleep are actually not reliable as an index of sleepi- 
ness if the subject is driving. 

For example, although in general eye blink rate has a 
tendency to rise with increasing sleepiness, this rate of 
5 change is confounded by the demand, variety and so stimu- 
lus content or level of a task undertaken (eg driving), there 
being a negative correlation between blink rate and task 
difficulty. 

In an attempt to prevent sleep-related vehicle accidents, it 
is also known passively to monitor driver working times 
through chronological activity logs, such as tachographs. 
However, these provide no active warning indication. 

More generally, it is also known to monitor a whole range 
of machine and human factors for vehicle engineering 
development purposes, some merely for historic data 
accumulation, and other unsatisfactory attempts at *real- 
time' active warning. 

The Applicants are not aware of any practical implemen- 
tation hidierto of sleepiness detection, using relevant and 
proven biological factors addressing inherent body condi- 
tion and capacity. 

Studies and trials carried out by the Applicants have 
shown that there are clear discernible peaks of sleep-related 
'>5 vehicle accidents in the UK around 02.00-06.00 hours and 
14.00-16.00 hours. 

Similar time-of-day data for such accidents have been 
reported for the USA, Israel and Finland. 

These sleep-related vehicle accident peaks are distinct 
30 from the peak times for all road traffic accidents in the 
UK — which are around the main commuting times of 08.00 
hours and 17.00 hours. 

The term 'sleepiness' is used herein to embrace essen- 
tially pre -sleep conditions, rather than sleep detection itself, 
35 since, once allowed to fall asleep, it may be too late to 
provide useful accident avoidance warning indication or 
correction. 

Generally, a condition or state of sleepiness dictates 
a lessened awareness of surroundings and events 
a reduced capacity to react appropriately; and 
an extended reaction time. 

It is known from sleep research studies that the normal 
himnan body biological or physiological activity varies with 
45 the time of day, over a 24 hour, (night-day-night) cycle — in 
a characteristic regular pattern, identified as the circadian 
rhythm, biorhythm or body clock. 

The human body thus has a certain predisposition to 
drowsiness or sleep at certain periods during the day — 
50 especially in early morning hours and mid afternoon. 

This is exacerbated by metabolic factors, in particular 
consumption of alcohol, rather than necessarily food per se. 

SUMMARY OF THE INVENTION 

55 According to one aspect of the invention a monitor taking 
account of circadian and sleep parameters of an individual 
vehicle driver, and/or generic or universal human physi- 
ological factors, applicable to a whole class or category of 
drivers, is integrated with *real-time' behavioural sensing, 

60 such as of road condition and driver control action, including 
steering and acceleration, to provide an (audio-) visual 
indication of sleepiness. 

For safety and legislative reasons, it is not envisaged that, 
at least in the immediate future, an alert condition would 

65 necessarily be allowed automatically to override driver 
control — say by progressively disabling or disengaging the 
vehicle accelerator. 
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Rather, it would remain a driver's responsibility to 
respond constructively to an alert issued by the system — 
which could log the issue of such warnings for future 
reference in assessing compliance. 

Overall system capability could include one or more of 
such factors as: 

common, if not universal, underlying patterns or sleepi- 
ness (pre-conditioning); 

exacerbating personal factors for a particular user — 
driver, such as recent sleep patterns especially, recent 
sleep deprivation and/or disruption; 

with a weighting according to other factors, such as the 
current time of day. 

Thus background circumstances, in particular a natural 
alertness *low point' — and attendant sleepiness or suscepti- 
bility to (imprompted) sleep — in the natural physiological 
biorhythmic or circadian cycle may pre-dispose a driver to 
sleepiness, exacerbated by sleep deprivation in a recent 
normal sleep period. 

If not circadian rhythm patterns themselves, at: least the 
ability of the body behaviour and activity to respond to the 
underlying pre-disposition or pre-condition, may be dis- 
turbed or frustrated by abnormal or changing shift: patterns, 
prefaced by inadequate accUmatisation. 

Thus, for example, in exercising vehicle control, aberrant 
driver steering behaviour, associated with degrees of driver 
sleepiness, could be recognised and corrected — or at: least a 
warning issued of the need for correction (by sleep 
restitution). 

Pragmatically, any sleepiness warning indication should 
be of a kind and in sufficient time to trigger corrective action. 

According to another aspect of the invention, a driver 
sleepiness, alermess or fitness condition monitor comprises 
a plurality of sensory inputs, variously and respectively 
related to, vehicle motion and steering direction, circadian or 
biorhythmic physiological patterns, recent driver experi- 
ences and preconditioning; 

such inputs being individually weighted, according to 
contributory importance, and combined in a computa- 
tional decision algorithm or model, to provide a warn- 
ing indication of sleepiness. 

Some embodiments of the invention can take into account 
actual, or real-time, vehicle driving actions, such as use of 
steering and accelerator, and integrate them with inherent 
biological factors and current personal data, for example 
recent sleep pattern, age, sex, recent alcohol consumption 
(within the legal limit), reliant upon input by a driver being 
monitored. 

Steering action or performance is best assessed when 
driving along a relatively straight road, such as a trunk, 
arterial road or motorway, when steering inputs of an alert 
driver are characterised by frequent, minor correction. 

In this regard, certain roads have characteristics, such as 
prolonged *straightness' and monotonous contouring or 
landscaping, which are known to engender or accentuate 
driver sleepiness. 

It is envisaged that embodiments of the steering detector 
will also be able to recognise when a vehicle is on such 
(typically straighter) roads. 

Some means, eidier automatically through a steering 
sensor, or even from manual input by the driver, is desirable 
for motorway as opposed to, say, town driving conditions, 
where large steering movements obscure steering irregulari- 
ties or inconsistencies. 

Indeed the very act of frequent steering tends to contribute 
to, or stimulate, wakefulness. Yet a countervailing tendency 
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to inconsistent or erratic steering input may prevail, which 
when recognised can signal an underlying sleepiness ten- 
dency. 

In practice, having recognised the onset of journeys on 
roads with an enhanced sleepiness risk factor, journey times 
on such roads beyond a prescribed threshold — say 10 
minutes — could trigger a steering action detection mode, 
with a comparative test against a steering characteristic 
algorithm, to detect sleepy-type driving, and issue a warning 
indication in good time for corrective action. 

As another vehicle control condition indicator, accelerator 
action, such as steadiness of depression, is dififerently 
assessed for cars than lorries, because of the different spring 
return action. 

Implementation of semi-automated controls, such as 
*5 cruise-controls, with constant speed setting capabilities, 
could be disabled temporarily for sleepiness monitoring. 

In assessing driver responses to pre-progranmied device 
interrogation, reliance is necessarily placed upon the good 
intentions, frankness and honesty of the individual. 

A practical device would embody a visual and/or auditory 
display to relay warning messages and instructions to and 
responses from the user. 

Similarly, interfaces for vehicle condition sensors, such as 
those monitoring steering and accelerator use, would be 
incorporated. 

Furthermore, input (push-button) switches for driver 
responses could also be featured — conveniently adjacent the 
visual display. 

Input effort would be minimal to encourage participation, 
and questions would be straightforward and direct, to 
encourage explicit answers. 

Visual display reinforcement messages could be com- 
bined with the auditory output. 

Ancillary factors, such as driver age and sex, could also 
be input. 

An interface with a global positioning receiver and map 
database could also be envisaged, so that the sleepiness 
indicator could register automatically roads with particular 
characteristics, including a poor accident record, and adjust 
the monitoring criteria and output warning display accord- 
ingly. 

The device could be, say, dashboard or steering wheel 
mounted, for accessibility and readability to the driver. 

Ambient external light conditions could be sensed by a 
photocell. Attention could thus be paid at night to road 
lighting conditions. 

Vehicle driving cab temperature could have a profound 
effect upon sleepiness, and again could be monitored by a 
localised transducer at the driver station. 

The device could categorise sleepiness to an arbitrary 
scale. Thus, for example, the following condition levels 
could be allocated: 
ALERT 

A LITTLE SLEEPY 
NOTICEABLY SLEEPY 
DIFFICULTY IN STAYING AWAKE 
HGHTING SLEEP 
WILL FALL ASLEEP 
Personal questions could include: 
QUANTITY OF SLEEP IN THE LAST 24 HOURS 
QUALITY OF THAT SLEEP IN THE LAST 24 HOURS 
Road conditions could include: 
MOTORWAY 
MONOTONOUS 
TOWN 

Night-time with no street lights could be given a blanket 
impairment rating or loading. 
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Assumptions are initially made of no alcohol consump- installation, for example as a dashboard mounting, or, as 

tion whatsoever (ie legal limits disregarded). depicted in FIG. 2, mounted on the steering wheel 12 itself. 

A circadian rhythm model allows a likelihood of falling The monitor 10 may include a memory lOa and computer 

asleep, or a sleep propensity, categorised between levels 1 lOZ?. 

and 4 — where 4 represents very likely and 1 represents 5 In a preferred variant, the monitor 10 could be self- 
unlikely, contained, with an internal battery power supply and all the 
The lowest likelihood of sleepiness occurs from mid necessary sensors fitted internally, to allow the device to be 
morning to early afternoon, personal to a driver and moved with the driver from one 

Thereafter a mid afternoon lull, or rise in likelihood of vehicle to another, 

sleepiness to 3 is followed by another trough of 1 in early lo interface 19, for example a multi-way proprietary 

evening, rising stepwise towards late night, through mid- plug-and-socket connector, is provided in the housing, to 

night and into the early hours of the morning. interconnection with an additional external vehicle 

battery power supply and various sensors monitoring certain 

BRIEF DESCRIPTION OF THE PREFERRED vehicle conditions and attendant driver control action. 

EMBODIMENTS 15 ^ steering wheel movement sensor 13 monitors 

steering inputs from a driver (not shown) to steering wheel 

There now follows a description of some particular 12. 

embodiments of the invention, by way of example only, with The sensor 13 could be located within the steering wheel 

reference to the accompanying diagrammatic and schematic 12 and column assembly. 

drawings, m which: ^^^^ sophisticated integrated multi-channel, remote 

FIG. 1 shows the circuit layout of principal elements in a " sensing is described later in relation to HGS. 11 and 12. 

sleepiness monitor for a road vehicle driver; Similarly, an accelerator movement sensor 15 monitors 

FIG. 2 show an installation variant for the indicator and driver inputs to an accelerator pedal 14. 

control unit of the sleepiness monitor shown in FIG. 1; Alternatively, and again in a more sophisticated sensor 

FIG. 3 shows a graphical plot of varying susceptibility to 25 variant, a dynamic accelerometer could be employed, as in 

sleepiness over a 24 hour period, reflecting human body FIGS. 11 and 12. 

circadian rhythm patterns; The sensor 15 could be an accelerometer located within 

FIGS. 4 and 5, 6 and 7, 8 and 9 show paired personal the housing 11 in a self-contained variant. Care is taken to 

performance graphs reflecting steering wheel inputs for obviate the adverse eff"ects of vehicle vibration upon 

diree individual drivers, each pair representing comparative dynamic sensory measurements. 

alert and sleepy (simulated) driving conditions; Albeit, somewhat less conveniently, vehicle motion and 

FIG. 10 shows principal elements of a driver monitor acceleration could be recognised through a transmission 

system, with an integrated multi-mode sensing module; ^^^^ s^^^ft sensor 27, coupled to a vehicle road wheel 26 or 

rrrr^ 1 1 u . r j by interfacing with existing sensors or control processors for 

FIG. 11 shows a sensmg arrangement for motion and ,c ^ . ^ . ^ 

^ • • w , £ J ^ other purposes, such as engine and transmission manage- 

steenng, in relation to respective reference or damm axes, f > & 5 

for the multi-mode sensing module of FIGS. 10 and 12 (see ' 

legend in Table 1); ^^^^ multiplex vehicle electrical supply systems, 

TTii-i 1^ u 1 1 • J • relaying data between vehicle operational modules, may 

FIG. 12 shows the multi-mode sensor of FIG. 10 in more f^^iutJ^^ ...^u ;„t^r^^„„^^^;„„ 

J racilitate such interconnection, 

detail; 40 * * ... . ■ . , ^ 

More sophisticated sensors, with an ability for remote 

HGS. 13A through 13D show a vanant housing for the self-contained condition sensing, data accumulation and 

multi-mode sensor of HGS. 10 and 12; ^^^a transfer, data down-loading or data up-loading may be 

FIGS. 14A and 14B show steering wheel dynamic sensing employed, 

geometry (see legend in Table 2); Thus, for example, a steering wheel movement sensor 

FIGS. 15 A through 15D show steering wheel movement module, the version of FIG. 20, may rely upon a wireless or 

and attendant correction (see legend in Tables 3-4); contact-free linkage — such as magnetic flux coupling 

FIGS. 16A and 16B show vehicle acceleration and cor- between magnetic elements on the wheel or shaft and an 

rection (see legend in Table 5); adjacent static inductive or capacitative transducer to regis- 

HG. 17 shows periodic variation of sleepiness/alertness 50 '^^^ change of wheel movement (as opposed to, say an 

and attendant warning threshold levels (see legend in Tables ^^^^^^^ computation of FIGS, 15A and 15B). 

10_11)- Such remote sensing and data linkage obviates the need 

HG.' 18 shows the sub-division of system operational ^""^ "^^j^^ ^^"^ supplement, 

time cycles (see legend in Table 6); Overall, the device could have an internal memory of 

™„ u . J . 1 speed and steering wheel movements and so the basis of a 

FIG. 19 shows system data storage or accumulation for ui.Z.^,^ a^.,^^ u .f a - 

, , ^ • T i_i -I performance history of driver actions as a basis for deci- 

computation (see legend m Tables 7-8); • • • • • j- 

^ ^ ^ sion upon issuing warning mdication. 

FIG. 20 shows a circuit diagram of a particular multi- ^he interface 19 would enable data to be down-loaded 

mode sensor with a magnetic-inductive flux coupling sens- ^nto a PC via, say, the PC parallel port or over a radio or 

mg of rate of change of steenng wheel movement; and infra-red 'wireless' link. 

HG. 21 is a flow chart depicting communication among a further photocell sensor 29 monitors ambient light 

various system components. conditions from the driving position and is calibrated to 

DESCRIPTION OF THE PREFERRED T"'' ^^l*' t^r"^^^^ transitions and the presence or absence 

EMBODIMENTS ^^^^^ ^%^^^^Z at night. 

65 In the variants 10, 12 and 13A through 13D, multi-mode 

Referring to HG. 1, a sleepiness monitor 10 is integrated or multiple (independent) factor sensing is integrated within 

within a housing 11, configured for ease of in-vehicle a common co-called ^steering wheel adaptor' module 33. 
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Reverting to the unit 10 of FIGS. 1 and 2, the housing 11 
incorporates a visual display panel or screen 18, for relaying 
instructions and warning indications to the user. 

A touch-sensitive inter-actional screen could be deployed. 

Manual or automated adjustment for screen contrast ^ 
according to ambient light conditions could be embodied. 

The variants of HGS. 10, 12 and 13A through 13D allow 
for a simpler devolved display of certain operating criteria, 
by multiple LED's on a multi-mode sensor module 33. 

A loudspeaker 21 can relay reinforcement sound 
messages, for an integrated audio-visual driver interaction. 

Also to that end, in a more sophisticated variant — 
possibly merely as an ongoing research and development 
tool, a microphone 23 might be used to record and interpret 15 
driver responses, possibly using speech recognition soft- 
ware. 

Alternatively, interactive driver interrogation and 
response can be implemented by a series of push button 
switches 16 arrayed alongside the screen 18, for the input of 
individual driver responses to preliminary questions dis- 
played upon the screen 18. 

Thus, for example, non-contentious factors, such as driver 
age and sex may be accounted for, together with more 
subjective review of recent sleep history. 

Questions would be phrased concisely and unequivocally, 
for ease and immediacy of comprehension and certainty or 
authenticity of response. 

Thus, for example, on the pivotal contributory factor of 30 
driver* s recent sleep, the question: 

'How much sleep have you had in the last 24 hours' could 
be juxtaposed with a multiple choice on screen answer 
menu, such as: 

Choice of ONE answer ... 35 
Little or none . . . [generating a weighting score of 2] 
Less than normal . . . [score I] 
About the same as normal, undisturbed . . . [score 0] 
About the same as normal, but disturbed . . . [score 
1] 40 

Other contributory factors include road conditions and 
vehicle cabin temperamre. 

Road conditions would be assessed through the steering 
sensor 13, and through an initial input question upon road 
conditions. 45 

Thus, a dull, monotonous road would justify a weighting 
of plus 1 to all the circadian scores. 

On the other hand, town driving, promoting greater alert- 
ness from external stimuli, would merit a score of minus 1. 

Vehicle cabin temperature is taken into account, primarily 50 
to register excessively high temperatures which might 
induce sleepiness. 

Driver cab temperatures could be monitored with a tem- 
perature sensor probe 31 (located away from any heater 
output vents). 55 

Thus, for example, a threshold of some 25 degrees C 
might be set, with temperatures in excess of this level 
triggering a score of plus 0.5. 

In normal operating mode, the monitor relies upon the 
working assumption that the driver has had little or no recent 60 
or material alcohol consumption. 

The physiological circadian rhythm 'template' or refer- 
ence model pre-loaded into the monitor memory is adjusted 
with the weighting scores indicated. 

If the cumulative score is equal to or greater than 3, the 65 
steering sensor is actively engaged and checked to determine 
the road conditions. 



The sleepiness scale values, reflected in the unweighted 
graph of FIG. 3, can broadly be categorised as: 
ALERT 

NEITHER ALERT NOR SLEEPY 
A LITTLE SLEEPY 
NOTICEABLY SLEEPY 
DIFHCULTY IN STAYING AWAKE 
FIGHTING SLEEP 
WILL FALL ASLEEP 

An internal memory module may store data from the 
various remote sensors 13, 15, 27, 29, 31 — together with 
models or algorithms of human body circadian rhythms and 
weighting factors to be applied to individual sensory inputs. 

An internal microprocessor is programmed to perform 
calculations according to driver and sensory inputs and to 
provide an appropriate (audio-)visuai warning indication of 
sleepiness through the display screen 18. 

FIG. 2 shows a steering-wheel mounted variant, in which 
the housing 11 sits between lower radial spokes 17 on the 
underside of a steering wheel 12 — in a prominent viewing 
position for the driver, but not obstructing the existing 
instrumentation, in particular speedometer, nor any air bag 
fitted. 

Ambient temperamre and lighting could also be assessed 
from this steering wheel vantage point. 

This location also facilitates registering of steering wheel 
movement. Widi an internal accelerometer and battery, 
external connections could be obviated. 

Whilst a motor vehicle orientated monitor has been dis- 
closed in the foregoing example, the operating principles are 
more widely applicable to moving machine-operator 
environments, as diverse as cranes, construction site exca- 
vators and drilling rigs — possibly subject to further research 
and development. 

FIGS. 4 through 9 show the respective steering 'perfor- 
mances' of three individual subjects, designated by refer- 
ences SI, S2 and S3, under alert and sleepy (simulated) 
driving conditions. 

Each graph comprises two associated plots, representing 
steering wheel movement in different ways. 

Thus, one plot directly expresses deviations of steering 
wheel position from a straight-ahead reference position — 
allotted a 'zero' value. 

This plot depicts the number of times a steering wheel is 
turned in either direction, over a given time period — allow- 
ing for a ±3% 'wobble' factor as a 'dead' or neutral band 
about the reference position. 

The other plot is an averaged value of steering wheel 
movement amplitude (ie the extent of movement from the 
reference position) — using the RMS (root mean squared) of 
the actual movements. 

Generally, the graphs reflect a characteristic steering 
performance or behaviour. 

In particular, as a person becomes sleepy, zero crossings 
are reduced in frequency, whereas RMS amplimdes increase 
and/or become more variable. 

Thus, FIG. 4 reflects steering behaviour of an alert subject 
SI. 

Collectively, the 'zero-crossing' and 'RMS' plots for alert 
subject SI reflect a generally continual and consistent steer- 
ing correction. 

In contrast, the steering behaviour of a sleepy subject SI, 
reflected in FIG. 5, exhibits less frequent, erratic, exagger- 
ated or excessive steering movement. 

FIG. 6 reflects steering behaviour for another alert subject 
S2, whilst FIG. 7 shows the corresponding readings when 
the same subject was sleepy. 
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FIG. 8 reflects steering behaviour of yet another alert FIGS. 14 A through 15D relate to wheel movement sens- 
subject S3 and FIG. 9 that of that subject S3 when sleepy. ing by a more direct computational technique, involving 

Each pair of graphs shows corresponding marked differ- RMS averaging, compared widi die direct rate of change 

ences in steering behaviour between an alert and sleepy capability of magnetic flux-coupled inductive sensing of the 
<lriver. 5 FIG. 20 circuitry. 

This characteristic difference validates the use of actual or piGS. 14A and 14B represent dynamic steering wheel 

real-time dynamic steering behaviour to monitor driver movement sensing 

sleepmess, . ^ , FIGS. 15A and 15B represent respectively *raw^ and 

In a practical system, usmg steenng wheel movement to ^^^^^^^^ ^^^^^ movements over time. 

Identify sleepmess on the basis of such findmgs, it is '^^^ ^^ ^^^^^^ ^ .^^^^ ^^^^^^ 

preferred that, before presenting a sleepiness warning - ^- . j i r r-jr^ ^rr, 

indication, at least two of the following three sleep categor- ^'^^^'^^^T^ , , , 

ising conditions of steering behaviour are present, namely: FIG 15D depicts the dead band range of wheel move- 



ment allowed. 

FIGS. 16A and 16B respectively, represent 'raw' and 



Fewer zero crossings; 

RMS amplimde high; . , ^ , - t i • „ • 

r»A*c • ui 15 corrected plots of vehicle acceleration over time — allowing 

RMS more vanable. ^ ,e i . ^ 

RMS averaging may be superseded by other sensing computation of an RMS average acceleration, 

techniques, such that of the magnetic flux-coupled, indue J^^' ^^P^^^^ a charactenstic cu-cadian sleepiness 

tive sensor of FIG, 20, which can register more directiy rate [^y^f ^ «^ P^"^"^' ^'^^ sleepiness wammg threshold 

of change of steering wheel movement. levels. 

Turning to refinement of practical implementation, FIG. ^0 FIG. 18 represents a breakdown of system activity over 

10 shows a block schematic overall circuit layout or prin- (^=60 second) operational clock cycles— with a division 

ciple elements. between monitoring the various sensors over 50 seconds and 

More specifically, the various sensing modes— including 10 seconds process time allocation for parameter 

vehicle motion (linear acceleration), steering wheel angle, calculation, test and warning issue, display screen update, 

ambient light, temperature, are combined with an audio 25 sensor data storage of calculated parameters, 

sounder and mark button in an integrated so-called 'steering FIG. 19 represents data storage array allocation, for 

wheel adaptor' module 33. monitoring and learning of factors such as vehicle accelera- 

The sensor module 33 is connected through a cable way tion and wheel movement, 

to an electronic interface 32, which in turn is configured for piG. 21 depicts the flow of information during the 

connection to a personal computer parallel pon 39 through 30 memory, operation control input, computational means, and 

a cable fink and a mains charger unit 37. ^he sleepiness warning indicator. 

The orientation of the sensor inodule 33 in relation to Hardware considerations aside, an operation software 

reference axes for acceleration and steenng wheel angular ^^^^^^y ^^^^^ -^^^^^^ ^ ^^^^^^ ^^^^ ^ 

position are represented in FIGS. 11 and 12. represented in the Tables below which are generally self- 

Angular sensing could be, say, through a vanable mag- 1 , j -n * *u • u j- j 

fl.w K^*„,^^„ o*^«^«„ 35 explanatory and will not otherwise be discussed, 

netic flux coupling between magnets set on the steenng ^ 

wheel or column and on adjacent static mounts. Component List 

nGS. 13 A through 13D show a master sensor unit 33 

with a simplified LED warning indicator array. The detailed (sleepiness) monitor 

circuitry is shown in FIG. 20. 11 housmg 

Essentially, the steering sensor measures a change in steering wheel 

inductance through an array of some three inductors LI, L2 1^ steering position/movement sensor 

and L3 through magnetic flux coupling changes caused by 14 accelerator pedal 

movement in relation to the magnetic field of a small magnet 15 accelerator position/movement sensor 

'M' static-mounted upon the steering column — at a 16 push-button switch 

convenient, unobtrusive location. 45 17 steering wheel spokes 

The inductors LI, L2 and L3 are energised by a 32 kHz 18 display panel/screen 

square wave generated by a local processor clock. 19 interface connector 

Induced voltage is rectified, smoothed, sampled and mea- 21 loudspeaker 

sured by the local processor some 16 times per second. 23 microphone 

The processor analyses the results digitafly to determine 50 26 road wheel 

the extent of steering wheel movement. 27 (drive) shaft sensor 

Calibration of the minimum and maximum voltages 29 photocell sensor 

across each inductor as the magnetic field of the static 31 temperature probe 

magnet sweeps across them when the steering wheel is fully 33 multi-mode sensor 

turned is undertaken by the local processor, so the mounting 55 32 electronic interface 

location of the static magnet is not overfly critical. 37 mains charger 

Such inductive sensing is unaffected by road vibration, 39 parallel data port 

since both static magnet and inductors are subject to the LITERATURE REFERENCES 
same vibration and any effect cancelled out. 

The local processor feeds sensor data to an executive 60 J. Sleep Research 1994 vol 3 pi 95; * Accidents & Sleepi- 

processor loaded with sleepiness detector algorithms, based ness': consensus of Stockholm International Conference 

upon such factors as circadian rhythm of sleepiness, timing on work hours, sleepiness and accidents, 

and duration of sleep and ambient light, and which presents J, Sleep Research 1995 suppl. 2 p23-29; 'Driver Sleepi- 

an overall indication of driver sleepiness level. ness': J. A. Home & L. A. Reyner 

The arrangement is capable of registering and measuring 65 British Medical Journal 4 March 1995 vol 310 p565-567; 

very small angular movements, such as might be encoun- *Sleep related vehicle accidents': J. A. Home & L. A. 

tered in corrective steering action at speed. Reyner 
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Int J Legal Med 1998; 'Falling asleep whilst driving: are 
drivers aware of prior sleepiness?: L. A. Reyner & J. A. 
Home 

TABLE 1 5 

Acc # 1 -Vehicle Motion 
Acc # 2- Wheel Angle 

Light Sensor - Ambient 10 
Temp Sensor - Ambient 
Sounder 
Mark Button 



TABLE 2 



W - Wheel Rotation Angle 

X - Measured component of g in sensor axis (m/s/s) 
K wheel - Sensor scaling factor (mm/s/s/bit) 
g - Gravity 9.81 m/s/s 

g - Gravity Vector Component in wheel Plane 
Sin W = X/g 

X = k wheel / 1000 x (Ch{l )-ZeroWheel) x l/Cos( Alpha) 

Sin W = k wheel / (1000 x g) x (Ch(l)-ZeroWheel) x (l/Cos(Alpha) 

W + ArcSin [Kwheel/(1000 x g) x (Ch( D-ZeroWheel) x l/Cos(Alpha)] 



TABLE 3 



RMS Steering Angle -R(Deg) 



■7 



IWheel [n]- 



TABLE 4 



Boimd Check 



W Limit- < W < W Limit + 
W < W Limit - 
W > W Limit -I- 



Steering Mode = Corrective 
Steering Mode = Active 
Steering Mode = Active 



TABLE 5 



RMS Vehicle Acceleration- G(m/s/s) 



^ IAcc[n]^ 



TABLE 6 





Calculate Parameters 


T cycle = 60 s 


Test & Issue Warnings 


T monitor = 50 s 


Update Screen Display 


T process 10 s 


Store Sensor Data > Disk 


Store Calculated Parameters > Disk 



TABLE 7 



Note: 

Data storage @ 1 Hz 
Zero Acc = Average {Raw Acc [n]} 
Zero Wheel = Average {RawWheel[n]} 
Ch(N) = Raw ADC Value fbit) 



60 
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TABLE 



Acctn] = Kacc/1000 x (RawAcc[n] - ZeroAcc) x l/Cos( Alpha) 

(m/s/s) (mm/s/s/bit) (bit) (bit) 

Wheel[n] = ArcSin fKwheeV(1000 x 9.81) x 

(Raw Wheel [nl - Zerowheel) x l/Cos( Alpha)] 

(Deg) (mm/s/s/bit) (bit) (bit) 

I = Klight/1000 X (Ch(2) - ZeroUghi) 

(KLx) (Lx/bit) (bit) (bit) 

T = Ktemp/1000 x (Ch(3) - ZeroTemp) 

(DegC) (mDegC/bit) (bit) (bit) 



TABLE 9 



15 



20 



Engineering Scaling Factors 



K acc (mm/s/s/bit) 


Acceleration Channel 


K wheel (mm/s/s/bit) 


Steering Channel 


K light (Lx/bit) 


Light Channel 


K temp (mDegC/bit) 


Temp Channel 


ZeroLight (bit) 


Intercept adjust - Light 


ZeroTemp (bit) 


Intercept adjust - Temp 


Alpha (Deg) 


Steering Wheel Inclination from Vertical 


Hysterisis (Deg) 


Hesterisis factor - Zero X analysis 


TABLE 10 



Sleep Propensity Algorithm - Definition 
S mod = S circ + S zerox + S rms -i- S light + S temp + 
S sleep + S road + S trie* 



30 



35 



40 



Elemental 



Bound Limit 



S mod 0 < S mod < 1 

S circ 0 < S circ < 1 

S zerox = (F zerox/ 100) (Z ref-Z) 0 < S zerox 

S rms = (F rms/100) (R-R ref) 0 < S rms 

S light = (F light/100) (I ref -I) 0 < S Ught 

S temp = (F temp/100) (T -T ref) 0 < S temp 

S sleep = (F sleep/100) (H ref - (HXQ)) 0 < S sleep 

S road = (F road/ 100) (G ref -G) 0 < S road 

S trip = (F uip/100) X D 0 < S trip 



TABLE 11 



Algorithm Elementals - S 



45 S mod (S) Modified Sleep Propensity Factor-Range 0 ... 1 

S circ (S) Current Circadian Sleep Propensity Value 

S zerox (S) Current Corrective Steering Reversal Rate Deficit 

S rms (S) Current RMS Corrective Steering /Amplitude Surfit 

S light (S) Current Ambient Lighting Intensity Deficit 

S temp (S) Current Ambient Temperature Surfit 

50 S sleep (S) Prior Sleep Good Hours Deficit 

S road (S) Current Road Activity Deficit 

S trip (S) Accumulated Trip Duration 



55 



TABLE 12 



Algorithm Weighting Factors - F 
Note: Factors arc % S Unit per Parameter Unit 



F zerox (% S/#/min ) 
F rms (% S/Deg) 

F Ught (% S/kLx) 



F temp (% S/DegC) 
F sleep (%S/Hr) 
F road {% S/m/s/s) 
65 F trip i% S/Hr) 



Corrective Steering Reversal Rate Deficit - % Factor 
RMS Corrective Steering Amplitude Surfit - 
% Factor 

Average Ambient Lighting Intensity Deficit - 
% Factor 

Average Ambient Temperature Surfit - % Factor 
Prior to Good Hours Sleep Deficit - % Factor 
Road Activity Deficit - % Factor 
Accumulated Trip Duration - % Factor 
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14 



TABLE 13 



TABLE 18 



Algorithm Reference Oflffsets - ref 



Z ref (#/min) 



R ref (Deg) 



I ref (kLx) 



T ref (DegC) 



H ref (Hr) 



G ref (m/s/s) 



Corrective Steering Reversal Rate - Ref Offset 
Corresponds to 'Alert' Driving Subject Dependent 
Corrective Steering RMS Amplitude - Ref Offset 
Corresponds to 'Alert' Driving Subject Dependent 
Average Ambient Lighting Intensity - Ref Offset 
Conresponds to moderate daylight 
Average Ambient Temperature - Ref Offset 
Corresponds to moderate environment 
Prior to Good Hours Sleep - Ref Offset 
Corresponds to optimum value 
Road Activity - RMS Accelerauon/Deceleration - Ref 
Offset 



TABLE 14 



Algorithm Dynamic Variables 



Z (#/min) 
R (Deg) 
I (kLx) 
T (DegC) 
G (m/s/s) 
D(Hr) 
H(Hr) 
Q(#) 
Qx (#) 



Current Corrective Steering Zero X Rate 
Current RMS Corrective Steering Amplitude 
Current Ambient Lighting Intensity 
Current Ambient Temperature 

Current Road Activity - RMS Acceleration / Deceleration 

Accumulated Trip Duration 

Actual Hoiu-s of Prior Sleep 

Prior Sleep Quality - Normalised Scale 0 ... 1 

Prior Sleep Quality 

User Scale 1.2,3,4,5 

Q = Qx/5 



TABLE 15 

Steering Mode & Steering Limit -W limit 
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15 



20 



25 



30 



35 



40 



W limit (Deg) 


Decision limit - Steering mode detection + 
W limit > W > - W limit »> Corrective + 
W limit < W < - W limit »> Active 




Steering Mode 


Steering mode decision 






ACrnVE, CORRECTIVE 


45 



TABLE 16 



Alarm Levels & Alarm State 



50 



Data Directory Structure 



[ALGO]*.ALG 

Algorithm Data Files - Internal Format 
[USER]*.ALG 

User Data Files - Internal Format 
[XALGO]*.CSV 

Algorithm Data Files - CSV Format 

[XUSER]*.CSV 

User Data Files - CSV Formal 

[XDRIVE]*.CSV 

Drive Mode Data Files - CSV Format 
[XLEARN]*.CSV 

Learn Mode Data Files - CSV Fomiat 



TABLE 19 



File Structure - Program Internal Format 
Note : These files in program internal readable format 



Configuration File 


- SLEEPALT.CFG 


Save Set Values @ 


' Program Shut Down 


Load Set Value @ 


Program Initalisation 


K acc 


(mm/s/s/bit) 


K wheel 


(mm/s/s/bit) 


K light 


(Lx/bit) 


K temp 


(mDegC/bil) 


Kbatt 


(mV/bit) 


ZeroLight 


(bit) 


ZeroTemp 


(bit) 


Hysterysis 


(Deg) 


Alpha 


(Deg) 


AlgorithmID 




UserlD 




Circ[0] . . . [23] 


(S) 


FSD 


(0 . . . 1) 


Display Hist 


(min) 



TABLE 20 



Algorithm Data File [/VLGO]*.ALG 



F zerox 
F rms 
FUght 
F temp 
F sleep 
F road 
F trip 
Zref 
Rref 









I ref 


Alarm Level 1 (s) 


Alarm level threshold 




Tref 


Alarm Level 2 (s) 


Alarm level threshold 




Href 


Alarm Level 3 (s) 


Alarm level threshold 




Gref 


Alarm Holdoff (min) 


Initial alarm forced hold-off time - N minutes 




Alarm 1 


Alarm State 


Alarm status decision 


55 


AIarm2 




CLEAR, LEVELL LEVEL2, LEVEL3, 


Alarm3 




HOLDOFF 




AlarmHoldoff (min) 
W limit (Deg) 



(% S/#/min) 

(% S/Deg) 

(% S/Klx) 

{% S/DegC) 

(% S/Hr) 

(% S/m/s/s) 

(% s/Hr) 

(#/min) 

(Deg) 

(KLx) 

(DegC) 

(Hr) 

(ih/s/s) 

(s) 

(s) 

(s) 



TABLE 17 .0 

TABLE 21 



User Software Fimcuons — — 

Set Display Parameters User Data File [USER]*.USR 



Enter New Values and <RET> or <RET> to bypass edit option. UserName 
Display History (min) Graphic display history length - Last N minutes UserDoB 
FSD (S) Graphic display full scale - S unit (0 ... 1) 65 UserSex 
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TABLE 22 



TABLE 24-continued 



Data File Structure - Drive Mode Data File [XDRIVE]*.CSV 
Note: These files in external readable format - CSV 



DrivelD 

File Ceation Date 
Start Time (Hr 0 . . . 23) 
Start Time (min 0 . . . 59) 
UserlD 
AlgorithmID 
Alarm 1 (s) 
Alarm2 (s) 
Alarm3 (s) 
AlarmHoldOff (min) 
W limit (Deg) 
H (Hr) 
Q(0... 1) 
F zerox (% S/#/min) 
F rms {% S/Deg) 
F light (% S/kLx) 
F temp (% S/DegC) 
F sleep (% S/Hr) 
F road (% S/m/s/s) 
F trip (% S/Hr) 
Zref (#/min) 
Rref (Deg) 
I ref (Kix) 
Tref (DegC) 
Href (Hr) 
G ref (m/s/s) 
Minute Coimt (min) . 
Alarms tate 
SteeringMode 

Acceleration [IKm/s/s) Wheel[lJ(Deg) 



Z 
R 
I 

T 

G 



(#/min) 

(Deg) 

(KLx) 

(DegC) 

(m/s/s) 



. Repeat 1 . . . N(min) 



D (Hr) 

S mod (S) 
S circ(S) 
S zerox (S) 
S rms (S) 
S temp (S) 
S sleep (S) 
S road (S) 
S trip (S) 

DQC (Data Quality 
Code 0 . . . 255) 



Acceleration [50] 



Wheel[50] 



TABLE 23 



UserlD 

File Creation Date 
UserName 
UserDoB 
UserSex 



TABLE 24 



15 



20 



25 



30 



35 



Data File Structure - Learn Mode Data File fXLEARN]*.CSV 
Note : These files in external readable format - CSV 
Data File Structure - User Data File [XUSER]*.CSV 
Note : These files in extemal readable format - CSV 



Data File Structure - Algorithm Data File [XALG01*.CSV 
Note : These files in extemal readable format - CSV 

Algorithm ID 
File Creation Date 
F zerox (% S/#/min) 
F rms (% S/Deg) 
F light (% S/kLx) 
F temp (% S/DegC) 
F sleep (% S/Hr) 
F road {% S/m/s/s) 
F trip (% S/Hr) 
Zref (#/min) 
Rref (Deg) 
1 ref (KLx) 
Tref (DegC) 
Href (Hr) 
G ref (m/s/s) 



45 



50 



55 



60 



Data File Structure - Algorithm Data File [XALG01*.CSV 
Note : These files in extemal readable format - CSV 

Alarm 1 (s) 
Alann2 (s) 
Alarm3 (s) 
AlarmHoldOff (min) 
W limit (Deg) 



10 



What is claimed is: 

1. A sleepiness monitor for a vehicle driver, or machine 
operator, comprising: 

a sensor for sensing a driver or operator control input; 
a memory for storing an operational model that includes 
a physiological reference model of driver or operator 
circadian rhythm pattem(s) and a vehicle or machine 
operating model or algorithm; 
computational means for weighting the operational model 
according to time of day in relation to the driver or 
operator circadian rhythm pattem(s) and for deriving, 
from the weighted model, driver or operator sleepiness 
condition and producing an output determined thereby; 
and 

a warning indicator triggered by the computational means 
output, to provide a warning indicator of driver or 
operator sleepiness. 

2. The sleepiness monitor as claimed in claim 1, including 
a driver personal data entry interface, for entry of driver 
sleep pattern, age, sex, and recent alcohol consumption. 

3. The sleepiness monitor as claimed in claim 1, including 
provision, by way of switches, for input of responses to 
predetermined questions upon driver or operator condition, 
including recent sleep history. 

4. The sleepiness monitor as claimed in claim 1, wherein 
40 the sensor comprises a magnetic flux coupled, inductive 

sensor for rate of change of vehicle or machine steerage. 

5. The sleepiness monitor as claimed in claim 1, including 
a further sensor for vehicle acceleration and/or speed. 

6. The sleepiness monitor as claimed in claim 1, including 
a further sensor for vehicle cab temperature. 

7. The sleepiness monitor as claimed in claim 1, including 
a further sensor for ambient light. 

8. A vehicle or machine incorporating a sleepiness moni- 
tor as claimed in claim 1. 

9. A sleepiness monitor for a driver and vehicle, compris- 
ing: 

a sensor for sensing a steering movement, about a refer- 
ence position; 

a memory, for storing a circadian rhythm pattern or 
time-of-day physiological reference profile of pre- 
disposition to sleepiness; and 
computational means for computing steering transitions 
and weighing that computation according to time of 
day, to provide a warning indication of driver sleepi- 
ness. 



